The purpose of this wookbook is to analyze the data generated from the first portion of the project. I've removed a lot of code due to it's proprietary nature, but have left a majority of visuals to illustrate at a high level what that code does. The structure of this workbook is to illustrate the following:
1) Setup of the h2o cluster
2) Ideal model evaluation for product completion
3) Individual parameter exploratory investigation
I removed a lot of proprietary code, but the ideal is that a cluster has to be initialized with h2o with certain parameters. The api isn't very easy to use, so my team wrote an entire process to submit the necessary linux commands, grab the ip address, and connect to something initialized from the workbook. H2O allows for users to utilize up to a terabyte of cluster memory to process large datasets, with the only other limitation being constrained to a strict api preventing a lot of common operations from easily being performed.
dbName2 = 'mcbethk'
tableName2 = 'skybolt_hd_instby'
dat2 = importer2.Import(db_name=dbName2, table_name=tableName2, column_types=column_types)
Getting Numeric Columns Importing Data
2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing... 2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing... 2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing... 2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing... 2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing... 2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing... 2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing... DEBUG:skutil.data_import.data_import:Hive Importer start importing...
Parse progress: |█████████████████████████████████████████████████████████| 100%
2019-12-16 20:07:34,960[DEBUG]: Hive Import success 2019-12-16 20:07:34,960[DEBUG]: Hive Import success 2019-12-16 20:07:34,960[DEBUG]: Hive Import success 2019-12-16 20:07:34,960[DEBUG]: Hive Import success 2019-12-16 20:07:34,960[DEBUG]: Hive Import success 2019-12-16 20:07:34,960[DEBUG]: Hive Import success 2019-12-16 20:07:34,960[DEBUG]: Hive Import success DEBUG:skutil.data_import.data_import:Hive Import success
The purpose of this project was to compare the new parameters with the old. I managed to run a simple test by running the workflow on a single sub table. What's fascinating is that this simple table had a better train and validation auc than the original model. This indicates that this is better than our original methodolgy, without including any of the other 28 missing tables.
The most important metrics from this section are the model auc and the grading and crr plots. Those are the bottom two plots (blue bars and red lines). Those essentially measure the spread in the final score, comparing good to bad. This model yielded a 2.5 times spread, which is very comparable to what was originally found. These plots look much more stable than the model fitted on the other model, indicating that the parameters found in this section were much more stable than those found in the original method of aggregation.
There are a lot things occurring in this section. Essentially, the data is being split via time cuts into three sections. Then, each parameter is fit via a generalized linear model onto the target (pass or fail), utilizing the first two time bins. This step is repeated again on the last time bins. Finally the model is trained on the first two time bins and validated against the final time bin, for a final model that has been verified through multiple cuts of time (for generalizability). This model technically overfits, which is to be expected for data this imbalanced. This is not necessarily the worst result, as this target variable hasn't even developed, indicating that auc might improve over time as those drives have more time in the field such that they can fail.
%matplotlib inline
pd.options.display.max_rows = 999
testDat = mergedDat[mergedDat['prdct_product_format_capacity'] == 1800]
na_dat = testDat.isna()
na_percent = (na_dat.sum(return_frame=True)/na_dat.shape[0])
na_pandas = na_percent.as_data_frame().transpose().sort_values(by=0, ascending=False)
parameters = [x[5:-1] for x in na_pandas.loc[(na_pandas[0] <= 0.00001) & (na_pandas[0] >= 0.000007)].index.values.tolist()]
#run model via proprietary code
Transforming Data Imputing all columns in batch Generating Sets 5 bins processed 15 bins processed (317864, 611) (723350, 611) (1041214, 611) (1132874, 611) Train Target Labels:
| target | Count |
|---|---|
| FAIL | 315 |
| PASS | 317549 |
Validation Target Labels:
| target | Count |
|---|---|
| FAIL | 337 |
| PASS | 723013 |
Full Train Target Labels:
| target | Count |
|---|---|
| FAIL | 635 |
| PASS | 1.04058e+06 |
Test Target Labels:
| target | Count |
|---|---|
| FAIL | 377 |
| PASS | 1.1325e+06 |
Training Ship Date Max: 2018-06-07 00:00:00 Validation Ship Date Max: 2018-12-19 00:00:00 Test Ship Date Max: 2019-09-11 00:00:00 making directory: /mnt/notebooks/mcbethk/results/c2fi/tenMonths/skybolt/12_16_2019_16/fin2 2019-09-11 00:00:00 2019-05-14 00:00:00 Running key column selection in auc mode
/mnt/conda/lib/python3.6/site-packages/h2o/job.py:69: UserWarning: Reached maximum number of iterations 50!
['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2'] Selecting test columns Running test column selection in auc mode ['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2'] glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6409356570134224 Validation AUC 0.5428672521717572 Model Details ============= H2OGeneralizedLinearEstimator : Generalized Linear Modeling Model Key: GLM_model_python_1576526662757_6716 ModelMetricsBinomialGLM: glm ** Reported on train data. ** MSE: 0.0006171600894068796 RMSE: 0.02484270696616775 LogLoss: 0.005134640008859406 Null degrees of freedom: 1041213 Residual degrees of freedom: 1041200 Null deviance: 10670.499238872206 Residual deviance: 10692.518128315332 AIC: 10720.518128315332 AUC: 0.6409356570134224 pr_auc: 0.9996002576710424 Gini: 0.28187131402684473 Confusion Matrix (Act/Pred) for max f1 @ threshold = 9.497205468409194e-05:
| FAIL | PASS | Error | Rate | |
| FAIL | 0.0 | 635.0 | 1.0 | (635.0/635.0) |
| PASS | 0.0 | 1040579.0 | 0.0 | (0.0/1040579.0) |
| Total | 0.0 | 1041214.0 | 0.0006 | (635.0/1041214.0) |
Maximum Metrics: Maximum metrics at their respective thresholds
| metric | threshold | value | idx |
| max f1 | 0.0000950 | 0.9996950 | 399.0 |
| max f2 | 0.0000950 | 0.9998780 | 399.0 |
| max f0point5 | 0.0000950 | 0.9995120 | 399.0 |
| max accuracy | 0.0000950 | 0.9993901 | 399.0 |
| max precision | 0.9998915 | 1.0 | 0.0 |
| max recall | 0.0000950 | 1.0 | 399.0 |
| max specificity | 0.9998915 | 1.0 | 0.0 |
| max absolute_mcc | 0.9994409 | 0.0110937 | 68.0 |
| max min_per_class_accuracy | 0.9993424 | 0.5968504 | 85.0 |
| max mean_per_class_accuracy | 0.9994409 | 0.6120089 | 68.0 |
Gains/Lift Table: Avg response rate: 99.94 %, avg score: 99.93 %
| group | cumulative_data_fraction | lower_threshold | lift | cumulative_lift | response_rate | score | cumulative_response_rate | cumulative_score | capture_rate | cumulative_capture_rate | gain | cumulative_gain | |
| 1 | 0.0100008 | 0.9997365 | 1.0004181 | 1.0004181 | 0.9998079 | 0.9997579 | 0.9998079 | 0.9997579 | 0.0100050 | 0.0100050 | 0.0418052 | 0.0418052 | |
| 2 | 0.0200007 | 0.9997164 | 1.0003219 | 1.0003700 | 0.9997119 | 0.9997256 | 0.9997599 | 0.9997418 | 0.0100031 | 0.0200081 | 0.0321932 | 0.0369995 | |
| 3 | 0.0300006 | 0.9997029 | 1.0006102 | 1.0004501 | 1.0 | 0.9997093 | 0.9998399 | 0.9997310 | 0.0100060 | 0.0300141 | 0.0610237 | 0.0450073 | |
| 4 | 0.0400004 | 0.9996918 | 1.0006102 | 1.0004901 | 1.0 | 0.9996972 | 0.9998799 | 0.9997225 | 0.0100060 | 0.0400200 | 0.0610237 | 0.0490113 | |
| 5 | 0.0500003 | 0.9996821 | 1.0005141 | 1.0004949 | 0.9999040 | 0.9996869 | 0.9998848 | 0.9997154 | 0.0100050 | 0.0500250 | 0.0514136 | 0.0494917 | |
| 6 | 0.1000006 | 0.9996452 | 1.0004180 | 1.0004565 | 0.9998079 | 0.9996627 | 0.9998463 | 0.9996890 | 0.0500212 | 0.1000462 | 0.0418038 | 0.0456478 | |
| 7 | 0.1499999 | 0.9996155 | 1.0003796 | 1.0004308 | 0.9997695 | 0.9996300 | 0.9998207 | 0.9996694 | 0.0500183 | 0.1500645 | 0.0379593 | 0.0430850 | |
| 8 | 0.2000002 | 0.9995882 | 1.0003604 | 1.0004132 | 0.9997503 | 0.9996017 | 0.9998031 | 0.9996525 | 0.0500183 | 0.2000828 | 0.0360378 | 0.0413232 | |
| 9 | 0.2999998 | 0.9995344 | 1.0002835 | 1.0003700 | 0.9996735 | 0.9995614 | 0.9997599 | 0.9996221 | 0.1000280 | 0.3001108 | 0.0283495 | 0.0369986 | |
| 10 | 0.4000004 | 0.9994770 | 1.0001874 | 1.0003243 | 0.9995774 | 0.9995063 | 0.9997143 | 0.9995931 | 0.1000193 | 0.4001301 | 0.0187398 | 0.0324339 | |
| 11 | 0.5 | 0.9994127 | 1.0000048 | 1.0002604 | 0.9993949 | 0.9994456 | 0.9996504 | 0.9995636 | 0.1000001 | 0.5001302 | 0.0004803 | 0.0260432 | |
| 12 | 0.5999996 | 0.9993372 | 0.9998510 | 1.0001922 | 0.9992413 | 0.9993760 | 0.9995822 | 0.9995324 | 0.0999847 | 0.6001149 | -0.0148958 | 0.0192200 | |
| 13 | 0.7000002 | 0.9992451 | 0.9999183 | 1.0001531 | 0.9993085 | 0.9992930 | 0.9995431 | 0.9994982 | 0.0999924 | 0.7001073 | -0.0081681 | 0.0153074 | |
| 14 | 0.7999998 | 0.9991223 | 0.9997838 | 1.0001069 | 0.9991740 | 0.9991873 | 0.9994970 | 0.9994593 | 0.0999780 | 0.8000853 | -0.0216229 | 0.0106912 | |
| 15 | 0.8999994 | 0.9989128 | 0.9996973 | 1.0000614 | 0.9990876 | 0.9990303 | 0.9994515 | 0.9994116 | 0.0999693 | 0.9000547 | -0.0302720 | 0.0061397 | |
| 16 | 1.0 | 0.0000000 | 0.9994474 | 1.0 | 0.9988379 | 0.9983476 | 0.9993901 | 0.9993052 | 0.0999453 | 1.0 | -0.0552570 | 0.0 |
ModelMetricsBinomialGLM: glm ** Reported on validation data. ** MSE: 0.00034056863754448717 RMSE: 0.018454501823254053 LogLoss: 0.0030656339979223033 Null degrees of freedom: 1132873 Residual degrees of freedom: 1132860 Null deviance: 6963.075770731671 Residual deviance: 6945.954099520335 AIC: 6973.954099520335 AUC: 0.5428672521717572 pr_auc: 0.9996814550027422 Gini: 0.08573450434351448 Confusion Matrix (Act/Pred) for max f1 @ threshold = 3.169559289162015e-08:
| FAIL | PASS | Error | Rate | |
| FAIL | 0.0 | 377.0 | 1.0 | (377.0/377.0) |
| PASS | 0.0 | 1132497.0 | 0.0 | (0.0/1132497.0) |
| Total | 0.0 | 1132874.0 | 0.0003 | (377.0/1132874.0) |
Maximum Metrics: Maximum metrics at their respective thresholds
| metric | threshold | value | idx |
| max f1 | 0.0000000 | 0.9998336 | 399.0 |
| max f2 | 0.0000000 | 0.9999334 | 399.0 |
| max f0point5 | 0.0000000 | 0.9997338 | 399.0 |
| max accuracy | 0.0000000 | 0.9996672 | 399.0 |
| max precision | 0.9999216 | 1.0 | 0.0 |
| max recall | 0.0000000 | 1.0 | 399.0 |
| max specificity | 0.9999216 | 1.0 | 0.0 |
| max absolute_mcc | 0.9996103 | 0.0028328 | 72.0 |
| max min_per_class_accuracy | 0.9996031 | 0.5305040 | 75.0 |
| max mean_per_class_accuracy | 0.9996103 | 0.5388260 | 72.0 |
Gains/Lift Table: Avg response rate: 99.97 %, avg score: 99.96 %
| group | cumulative_data_fraction | lower_threshold | lift | cumulative_lift | response_rate | score | cumulative_response_rate | cumulative_score | capture_rate | cumulative_capture_rate | gain | cumulative_gain | |
| 1 | 0.0100002 | 0.9997775 | 1.0001563 | 1.0001563 | 0.9998235 | 0.9997939 | 0.9998235 | 0.9997939 | 0.0100018 | 0.0100018 | 0.0156296 | 0.0156296 | |
| 2 | 0.0200005 | 0.9997637 | 1.0000680 | 1.0001121 | 0.9997352 | 0.9997699 | 0.9997793 | 0.9997819 | 0.0100009 | 0.0200027 | 0.0067997 | 0.0112147 | |
| 3 | 0.0300007 | 0.9997544 | 1.0000680 | 1.0000974 | 0.9997352 | 0.9997588 | 0.9997646 | 0.9997742 | 0.0100009 | 0.0300036 | 0.0067997 | 0.0097430 | |
| 4 | 0.0400000 | 0.9997472 | 0.9998914 | 1.0000459 | 0.9995586 | 0.9997506 | 0.9997131 | 0.9997683 | 0.0099983 | 0.0400019 | -0.0108638 | 0.0045916 | |
| 5 | 0.0500003 | 0.9997411 | 0.9998914 | 1.0000150 | 0.9995587 | 0.9997441 | 0.9996822 | 0.9997635 | 0.0099991 | 0.0500010 | -0.0108599 | 0.0015013 | |
| 6 | 0.1000005 | 0.9997184 | 1.0001210 | 1.0000680 | 0.9997882 | 0.9997289 | 0.9997352 | 0.9997462 | 0.0500063 | 0.1000073 | 0.0120973 | 0.0067993 | |
| 7 | 0.1499999 | 0.9997015 | 1.0000856 | 1.0000739 | 0.9997528 | 0.9997096 | 0.9997411 | 0.9997340 | 0.0500037 | 0.1500110 | 0.0085648 | 0.0073878 | |
| 8 | 0.2000002 | 0.9996870 | 1.0000680 | 1.0000724 | 0.9997352 | 0.9996941 | 0.9997396 | 0.9997240 | 0.0500037 | 0.2000147 | 0.0067993 | 0.0072407 | |
| 9 | 0.2999998 | 0.9996612 | 0.9999797 | 1.0000415 | 0.9996469 | 0.9996739 | 0.9997087 | 0.9997073 | 0.0999976 | 0.3000123 | -0.0020310 | 0.0041501 | |
| 10 | 0.4000004 | 0.9996364 | 1.0000857 | 1.0000525 | 0.9997528 | 0.9996488 | 0.9997197 | 0.9996927 | 0.1000091 | 0.4000214 | 0.0085653 | 0.0052539 | |
| 11 | 0.5 | 0.9996105 | 1.0000327 | 1.0000486 | 0.9996999 | 0.9996236 | 0.9997158 | 0.9996789 | 0.1000029 | 0.5000243 | 0.0032670 | 0.0048565 | |
| 12 | 0.5999996 | 0.9995816 | 0.9999709 | 1.0000356 | 0.9996381 | 0.9995964 | 0.9997028 | 0.9996651 | 0.0999967 | 0.6000210 | -0.0029140 | 0.0035614 | |
| 13 | 0.7000002 | 0.9995463 | 0.9999709 | 1.0000264 | 0.9996381 | 0.9995647 | 0.9996936 | 0.9996508 | 0.0999976 | 0.7000186 | -0.0029137 | 0.0026364 | |
| 14 | 0.7999998 | 0.9994979 | 0.9999532 | 1.0000172 | 0.9996204 | 0.9995236 | 0.9996844 | 0.9996349 | 0.0999950 | 0.8000136 | -0.0046801 | 0.0017219 | |
| 15 | 0.8999995 | 0.9994129 | 0.9999885 | 1.0000140 | 0.9996557 | 0.9994607 | 0.9996812 | 0.9996155 | 0.0999985 | 0.9000121 | -0.0011480 | 0.0014030 | |
| 16 | 1.0 | 0.0000000 | 0.9998737 | 1.0 | 0.9995410 | 0.9991013 | 0.9996672 | 0.9995641 | 0.0999879 | 1.0 | -0.0126267 | 0.0 |
Scoring History:
| timestamp | duration | iterations | negative_log_likelihood | objective | |
| 2019-12-16 23:25:35 | 0.000 sec | 0 | 5335.2496194 | 0.0051241 | |
| 2019-12-16 23:25:35 | 0.018 sec | 1 | 5346.2590642 | 0.0051353 |
/mnt/conda/lib/python3.6/site-packages/matplotlib/cbook/__init__.py:424: MatplotlibDeprecationWarning: Passing one of 'on', 'true', 'off', 'false' as a boolean is deprecated; use an actual boolean (True/False) instead.
[2.33630189558061, 2.3391864122247013, 37872.67552885344, 38767.53752597171, 551.4884816776367, 521.9394089353505, 508.88985598214504, 1.8424273860190703, 1.8587606716895602, 1.8320484998763165, 0.017954333431227293, 0.01721293259782801, 0.01676939613226865] Parse progress: |█████████████████████████████████████████████████████████| 100% Here is the intercept -46.17264169946554 Parse progress: |█████████████████████████████████████████████████████████| 100% Generating Fluctuation Plot Parse progress: |█████████████████████████████████████████████████████████| 100% 86400000 (118, 1)
Saving Fluctuation Graph
Thresholds
D, C, B, A for fin2:
Percentage Value Grade
0 0.005 2.539424 D
1 0.300 4.699322 C
2 0.600 5.244047 B
3 1.000 9.514991 A
Probs exp(C1)Quantiles
0 0.005 2.539424
Parse progress: |█████████████████████████████████████████████████████████| 100%
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8,
0.9, 0.95, 0.98, 0.99, 1.0],
dtype='float64')
Generating Fluctuation Plot
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8,
0.9, 0.95, 0.98, 0.99, 1.0],
dtype='float64')
Generating Fluctuation Plot Generating CRR curve glm prediction progress: |████████████████████████████████████████████████| 100%
/mnt/notebooks/mcbethk/functions/masterFunctions.py:623: FutureWarning: Method .as_matrix will be removed in a future version. Use .values instead. /mnt/notebooks/mcbethk/functions/masterFunctions.py:630: FutureWarning: Method .as_matrix will be removed in a future version. Use .values instead.
making directory: /mnt/notebooks/mcbethk/results/c2fi/tenMonths/skybolt/12_16_2019_16/fnc2 2019-09-11 00:00:00 2019-05-14 00:00:00 Running key column selection in auc mode ['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2'] Selecting test columns Running test column selection in auc mode ['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2'] glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6409356570134224 Validation AUC 0.5428672521717572 Model Details ============= H2OGeneralizedLinearEstimator : Generalized Linear Modeling Model Key: GLM_model_python_1576526662757_7922 ModelMetricsBinomialGLM: glm ** Reported on train data. ** MSE: 0.0006171600894068796 RMSE: 0.02484270696616775 LogLoss: 0.005134640008859406 Null degrees of freedom: 1041213 Residual degrees of freedom: 1041200 Null deviance: 10670.499238872206 Residual deviance: 10692.518128315332 AIC: 10720.518128315332 AUC: 0.6409356570134224 pr_auc: 0.9996002576710424 Gini: 0.28187131402684473 Confusion Matrix (Act/Pred) for max f1 @ threshold = 9.497205468409194e-05:
| FAIL | PASS | Error | Rate | |
| FAIL | 0.0 | 635.0 | 1.0 | (635.0/635.0) |
| PASS | 0.0 | 1040579.0 | 0.0 | (0.0/1040579.0) |
| Total | 0.0 | 1041214.0 | 0.0006 | (635.0/1041214.0) |
Maximum Metrics: Maximum metrics at their respective thresholds
| metric | threshold | value | idx |
| max f1 | 0.0000950 | 0.9996950 | 399.0 |
| max f2 | 0.0000950 | 0.9998780 | 399.0 |
| max f0point5 | 0.0000950 | 0.9995120 | 399.0 |
| max accuracy | 0.0000950 | 0.9993901 | 399.0 |
| max precision | 0.9998915 | 1.0 | 0.0 |
| max recall | 0.0000950 | 1.0 | 399.0 |
| max specificity | 0.9998915 | 1.0 | 0.0 |
| max absolute_mcc | 0.9994409 | 0.0110937 | 68.0 |
| max min_per_class_accuracy | 0.9993424 | 0.5968504 | 85.0 |
| max mean_per_class_accuracy | 0.9994409 | 0.6120089 | 68.0 |
Gains/Lift Table: Avg response rate: 99.94 %, avg score: 99.93 %
| group | cumulative_data_fraction | lower_threshold | lift | cumulative_lift | response_rate | score | cumulative_response_rate | cumulative_score | capture_rate | cumulative_capture_rate | gain | cumulative_gain | |
| 1 | 0.0100008 | 0.9997365 | 1.0004181 | 1.0004181 | 0.9998079 | 0.9997579 | 0.9998079 | 0.9997579 | 0.0100050 | 0.0100050 | 0.0418052 | 0.0418052 | |
| 2 | 0.0200007 | 0.9997164 | 1.0003219 | 1.0003700 | 0.9997119 | 0.9997256 | 0.9997599 | 0.9997418 | 0.0100031 | 0.0200081 | 0.0321932 | 0.0369995 | |
| 3 | 0.0300006 | 0.9997029 | 1.0006102 | 1.0004501 | 1.0 | 0.9997093 | 0.9998399 | 0.9997310 | 0.0100060 | 0.0300141 | 0.0610237 | 0.0450073 | |
| 4 | 0.0400004 | 0.9996918 | 1.0006102 | 1.0004901 | 1.0 | 0.9996972 | 0.9998799 | 0.9997225 | 0.0100060 | 0.0400200 | 0.0610237 | 0.0490113 | |
| 5 | 0.0500003 | 0.9996821 | 1.0005141 | 1.0004949 | 0.9999040 | 0.9996869 | 0.9998848 | 0.9997154 | 0.0100050 | 0.0500250 | 0.0514136 | 0.0494917 | |
| 6 | 0.1000006 | 0.9996452 | 1.0004180 | 1.0004565 | 0.9998079 | 0.9996627 | 0.9998463 | 0.9996890 | 0.0500212 | 0.1000462 | 0.0418038 | 0.0456478 | |
| 7 | 0.1499999 | 0.9996155 | 1.0003796 | 1.0004308 | 0.9997695 | 0.9996300 | 0.9998207 | 0.9996694 | 0.0500183 | 0.1500645 | 0.0379593 | 0.0430850 | |
| 8 | 0.2000002 | 0.9995882 | 1.0003604 | 1.0004132 | 0.9997503 | 0.9996017 | 0.9998031 | 0.9996525 | 0.0500183 | 0.2000828 | 0.0360378 | 0.0413232 | |
| 9 | 0.2999998 | 0.9995344 | 1.0002835 | 1.0003700 | 0.9996735 | 0.9995614 | 0.9997599 | 0.9996221 | 0.1000280 | 0.3001108 | 0.0283495 | 0.0369986 | |
| 10 | 0.4000004 | 0.9994770 | 1.0001874 | 1.0003243 | 0.9995774 | 0.9995063 | 0.9997143 | 0.9995931 | 0.1000193 | 0.4001301 | 0.0187398 | 0.0324339 | |
| 11 | 0.5 | 0.9994127 | 1.0000048 | 1.0002604 | 0.9993949 | 0.9994456 | 0.9996504 | 0.9995636 | 0.1000001 | 0.5001302 | 0.0004803 | 0.0260432 | |
| 12 | 0.5999996 | 0.9993372 | 0.9998510 | 1.0001922 | 0.9992413 | 0.9993760 | 0.9995822 | 0.9995324 | 0.0999847 | 0.6001149 | -0.0148958 | 0.0192200 | |
| 13 | 0.7000002 | 0.9992451 | 0.9999183 | 1.0001531 | 0.9993085 | 0.9992930 | 0.9995431 | 0.9994982 | 0.0999924 | 0.7001073 | -0.0081681 | 0.0153074 | |
| 14 | 0.7999998 | 0.9991223 | 0.9997838 | 1.0001069 | 0.9991740 | 0.9991873 | 0.9994970 | 0.9994593 | 0.0999780 | 0.8000853 | -0.0216229 | 0.0106912 | |
| 15 | 0.8999994 | 0.9989128 | 0.9996973 | 1.0000614 | 0.9990876 | 0.9990303 | 0.9994515 | 0.9994116 | 0.0999693 | 0.9000547 | -0.0302720 | 0.0061397 | |
| 16 | 1.0 | 0.0000000 | 0.9994474 | 1.0 | 0.9988379 | 0.9983476 | 0.9993901 | 0.9993052 | 0.0999453 | 1.0 | -0.0552570 | 0.0 |
ModelMetricsBinomialGLM: glm ** Reported on validation data. ** MSE: 0.00034056863754448717 RMSE: 0.018454501823254053 LogLoss: 0.0030656339979223033 Null degrees of freedom: 1132873 Residual degrees of freedom: 1132860 Null deviance: 6963.075770731671 Residual deviance: 6945.954099520335 AIC: 6973.954099520335 AUC: 0.5428672521717572 pr_auc: 0.9996814550027422 Gini: 0.08573450434351448 Confusion Matrix (Act/Pred) for max f1 @ threshold = 3.169559289162015e-08:
| FAIL | PASS | Error | Rate | |
| FAIL | 0.0 | 377.0 | 1.0 | (377.0/377.0) |
| PASS | 0.0 | 1132497.0 | 0.0 | (0.0/1132497.0) |
| Total | 0.0 | 1132874.0 | 0.0003 | (377.0/1132874.0) |
Maximum Metrics: Maximum metrics at their respective thresholds
| metric | threshold | value | idx |
| max f1 | 0.0000000 | 0.9998336 | 399.0 |
| max f2 | 0.0000000 | 0.9999334 | 399.0 |
| max f0point5 | 0.0000000 | 0.9997338 | 399.0 |
| max accuracy | 0.0000000 | 0.9996672 | 399.0 |
| max precision | 0.9999216 | 1.0 | 0.0 |
| max recall | 0.0000000 | 1.0 | 399.0 |
| max specificity | 0.9999216 | 1.0 | 0.0 |
| max absolute_mcc | 0.9996103 | 0.0028328 | 72.0 |
| max min_per_class_accuracy | 0.9996031 | 0.5305040 | 75.0 |
| max mean_per_class_accuracy | 0.9996103 | 0.5388260 | 72.0 |
Gains/Lift Table: Avg response rate: 99.97 %, avg score: 99.96 %
| group | cumulative_data_fraction | lower_threshold | lift | cumulative_lift | response_rate | score | cumulative_response_rate | cumulative_score | capture_rate | cumulative_capture_rate | gain | cumulative_gain | |
| 1 | 0.0100002 | 0.9997775 | 1.0001563 | 1.0001563 | 0.9998235 | 0.9997939 | 0.9998235 | 0.9997939 | 0.0100018 | 0.0100018 | 0.0156296 | 0.0156296 | |
| 2 | 0.0200005 | 0.9997637 | 1.0000680 | 1.0001121 | 0.9997352 | 0.9997699 | 0.9997793 | 0.9997819 | 0.0100009 | 0.0200027 | 0.0067997 | 0.0112147 | |
| 3 | 0.0300007 | 0.9997544 | 1.0000680 | 1.0000974 | 0.9997352 | 0.9997588 | 0.9997646 | 0.9997742 | 0.0100009 | 0.0300036 | 0.0067997 | 0.0097430 | |
| 4 | 0.0400000 | 0.9997472 | 0.9998914 | 1.0000459 | 0.9995586 | 0.9997506 | 0.9997131 | 0.9997683 | 0.0099983 | 0.0400019 | -0.0108638 | 0.0045916 | |
| 5 | 0.0500003 | 0.9997411 | 0.9998914 | 1.0000150 | 0.9995587 | 0.9997441 | 0.9996822 | 0.9997635 | 0.0099991 | 0.0500010 | -0.0108599 | 0.0015013 | |
| 6 | 0.1000005 | 0.9997184 | 1.0001210 | 1.0000680 | 0.9997882 | 0.9997289 | 0.9997352 | 0.9997462 | 0.0500063 | 0.1000073 | 0.0120973 | 0.0067993 | |
| 7 | 0.1499999 | 0.9997015 | 1.0000856 | 1.0000739 | 0.9997528 | 0.9997096 | 0.9997411 | 0.9997340 | 0.0500037 | 0.1500110 | 0.0085648 | 0.0073878 | |
| 8 | 0.2000002 | 0.9996870 | 1.0000680 | 1.0000724 | 0.9997352 | 0.9996941 | 0.9997396 | 0.9997240 | 0.0500037 | 0.2000147 | 0.0067993 | 0.0072407 | |
| 9 | 0.2999998 | 0.9996612 | 0.9999797 | 1.0000415 | 0.9996469 | 0.9996739 | 0.9997087 | 0.9997073 | 0.0999976 | 0.3000123 | -0.0020310 | 0.0041501 | |
| 10 | 0.4000004 | 0.9996364 | 1.0000857 | 1.0000525 | 0.9997528 | 0.9996488 | 0.9997197 | 0.9996927 | 0.1000091 | 0.4000214 | 0.0085653 | 0.0052539 | |
| 11 | 0.5 | 0.9996105 | 1.0000327 | 1.0000486 | 0.9996999 | 0.9996236 | 0.9997158 | 0.9996789 | 0.1000029 | 0.5000243 | 0.0032670 | 0.0048565 | |
| 12 | 0.5999996 | 0.9995816 | 0.9999709 | 1.0000356 | 0.9996381 | 0.9995964 | 0.9997028 | 0.9996651 | 0.0999967 | 0.6000210 | -0.0029140 | 0.0035614 | |
| 13 | 0.7000002 | 0.9995463 | 0.9999709 | 1.0000264 | 0.9996381 | 0.9995647 | 0.9996936 | 0.9996508 | 0.0999976 | 0.7000186 | -0.0029137 | 0.0026364 | |
| 14 | 0.7999998 | 0.9994979 | 0.9999532 | 1.0000172 | 0.9996204 | 0.9995236 | 0.9996844 | 0.9996349 | 0.0999950 | 0.8000136 | -0.0046801 | 0.0017219 | |
| 15 | 0.8999995 | 0.9994129 | 0.9999885 | 1.0000140 | 0.9996557 | 0.9994607 | 0.9996812 | 0.9996155 | 0.0999985 | 0.9000121 | -0.0011480 | 0.0014030 | |
| 16 | 1.0 | 0.0000000 | 0.9998737 | 1.0 | 0.9995410 | 0.9991013 | 0.9996672 | 0.9995641 | 0.0999879 | 1.0 | -0.0126267 | 0.0 |
Scoring History:
| timestamp | duration | iterations | negative_log_likelihood | objective | |
| 2019-12-16 23:51:13 | 0.000 sec | 0 | 5335.2496194 | 0.0051241 | |
| 2019-12-16 23:51:13 | 0.024 sec | 1 | 5346.2590642 | 0.0051353 |
[2.33630189558061, 2.3391864122247013, 37872.67552885344, 38767.53752597171, 551.4884816776367, 521.9394089353505, 508.88985598214504, 1.8424273860190703, 1.8587606716895602, 1.8320484998763165, 0.017954333431227293, 0.01721293259782801, 0.01676939613226865] Parse progress: |█████████████████████████████████████████████████████████| 100% Here is the intercept -46.17264169946554 Parse progress: |█████████████████████████████████████████████████████████| 100% Generating Fluctuation Plot Parse progress: |█████████████████████████████████████████████████████████| 100% 86400000 (118, 1)
Saving Fluctuation Graph
Thresholds
D, A for fnc2:
Percentage Value Grade
0 0.005 2.539424 D
1 0.300 4.699322 C
2 0.600 5.244047 B
3 1.000 9.514991 A
Parse progress: |█████████████████████████████████████████████████████████| 100%
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8,
0.9, 0.95, 0.98, 0.99, 1.0],
dtype='float64')
Generating Fluctuation Plot
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8,
0.9, 0.95, 0.98, 0.99, 1.0],
dtype='float64')
Generating Fluctuation Plot Generating CRR curve glm prediction progress: |████████████████████████████████████████████████| 100%
This tool is the primary investigation tool for this project, as model evaluation is still a long way from being a true comparison between similar dataforms (despite already showing improvement from a single parameter). One of my previous concerns (and my last project) was to ensure that we were removing time for our analysis by checking removing time covariance with key parameters. That concern led to this method of evaluation, where the parameter is plotted alongside it's failure rate over the parameter span while also plotting its drift over time. For many of our previous modeling efforts.
Given that introduction, this code simply iterates through all the parameters, fits a generalized linear model to see if it could be used to find any linear separate between passers and failures, and if it meets an acceptable threshold (.52 validation auc) plots both the train and test failure vs parameter distribution plots and the paramater quantiles over time plots. The aucs for some of these individual parameters are roughly equivalent to that originally given by our starting aggregated model with over 1500 parameters.
Evaluating these plots is very difficult, but they demonstrate a fundamental issue with our data modeling techniques illustrating that new metrics are used, or the target variable is further split based into it's subcomponents for individual studying.
total = testDat.shape
parameters = [x[5:-1] for x in na_pandas.loc[(na_pandas[0] <= .8) & (na_pandas[0] >= .005)].index.values.tolist()]
#run exploratory analysis via proprietary code
skip_tracks_hd1_fnc2_spc1_aflaw_pad_18 skip_tracks_hd1_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.492267722597659 Validation AUC 0.5245076449683427
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_18 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5639470115758323 Validation AUC 0.47216205300711894 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_18 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5385723904850052 Validation AUC 0.5363519315848704
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_18 refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5604258064568904 Validation AUC 0.46327119772323266 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_18 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5441779121069038 Validation AUC 0.49633466724824277 skip_tracks_hd0_fnc2_spc1_aflaw_pad_18 skip_tracks_hd0_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5344422507543232 Validation AUC 0.49436023071657864 skip_tracks_hd4_fnc2_spc1_aflaw_pad_18 skip_tracks_hd4_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5121261718278827 Validation AUC 0.49185363813220107 skip_tracks_hd5_fnc2_spc1_aflaw_pad_18 skip_tracks_hd5_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5111686318532531 Validation AUC 0.4939482159179277 skip_tracks_hd3_fnc2_spc1_aflaw_pad_18 skip_tracks_hd3_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4848033132140824 Validation AUC 0.4969182130957882 skip_tracks_hd2_fnc2_spc1_aflaw_pad_18 skip_tracks_hd2_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.498135037532849 Validation AUC 0.45705599628895793 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_18 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5243919875164663 Validation AUC 0.5399487964451507
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_18 refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_18 0.5784815285581091 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4922632746304534 Validation AUC 0.5390109738525284
refined_srvo_flaw_cnt_hd3_fnc2_spc33100_aflaw_pad_16 refined_srvo_flaw_cnt_hd3_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5441750048991195 Validation AUC 0.49808531149689034 refined_srvo_flaw_cnt_hd0_fnc2_spc33100_aflaw_pad_16 refined_srvo_flaw_cnt_hd0_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5639461942164753 Validation AUC 0.4721587583481831 refined_srvo_flaw_cnt_hd0_fnc2_spc33400_aflaw_pad_17 refined_srvo_flaw_cnt_hd0_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5639461942164753 Validation AUC 0.4721587583481831 refined_srvo_flaw_cnt_hd1_fnc2_spc33400_aflaw_pad_17 refined_srvo_flaw_cnt_hd1_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5385674626661617 Validation AUC 0.5366376437669723
refined_srvo_flaw_cnt_hd2_fnc2_spc33100_aflaw_pad_16 refined_srvo_flaw_cnt_hd2_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5604223278121434 Validation AUC 0.4632693664072452 refined_srvo_flaw_cnt_hd2_fnc2_spc33400_aflaw_pad_17 refined_srvo_flaw_cnt_hd2_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5604223278121434 Validation AUC 0.4632693664072452 refined_srvo_flaw_cnt_hd3_fnc2_spc33400_aflaw_pad_17 refined_srvo_flaw_cnt_hd3_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5441750048991195 Validation AUC 0.49808531149689034 refined_srvo_flaw_cnt_hd4_fnc2_spc33400_aflaw_pad_17 refined_srvo_flaw_cnt_hd4_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4923022798339559 Validation AUC 0.5387509898577609
skip_tracks_hd0_fnc2_spc33400_aflaw_pad_17 skip_tracks_hd0_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5344412104440361 Validation AUC 0.49435843734210894 skip_tracks_hd0_fnc2_spc33100_aflaw_pad_16 skip_tracks_hd0_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5344412104440361 Validation AUC 0.49435843734210894 skip_tracks_hd1_fnc2_spc33100_aflaw_pad_16 skip_tracks_hd1_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.49226225401293244 Validation AUC 0.5245034868349056
refined_srvo_flaw_cnt_hd5_fnc2_spc33400_aflaw_pad_17 refined_srvo_flaw_cnt_hd5_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5243893334105716 Validation AUC 0.5457977544649294
refined_srvo_flaw_cnt_hd5_fnc2_spc33100_aflaw_pad_16 refined_srvo_flaw_cnt_hd5_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5243893334105716 Validation AUC 0.5457977544649294
refined_srvo_flaw_cnt_hd4_fnc2_spc33100_aflaw_pad_16 refined_srvo_flaw_cnt_hd4_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4923022798339559 Validation AUC 0.5387509898577609
refined_srvo_flaw_cnt_hd1_fnc2_spc33100_aflaw_pad_16 refined_srvo_flaw_cnt_hd1_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5385674626661617 Validation AUC 0.5366376437669723
skip_tracks_hd5_fnc2_spc33400_aflaw_pad_17 skip_tracks_hd5_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5111682358505051 Validation AUC 0.4939467703040074 skip_tracks_hd3_fnc2_spc33400_aflaw_pad_17 skip_tracks_hd3_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.48480130061423554 Validation AUC 0.4969170021807148 skip_tracks_hd2_fnc2_spc33400_aflaw_pad_17 skip_tracks_hd2_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4981338820768668 Validation AUC 0.4570521833729362 skip_tracks_hd5_fnc2_spc33100_aflaw_pad_16 skip_tracks_hd5_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5111682358505051 Validation AUC 0.4939467703040074 skip_tracks_hd4_fnc2_spc33100_aflaw_pad_16 skip_tracks_hd4_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.51212763786288 Validation AUC 0.49185545967360733 skip_tracks_hd4_fnc2_spc33400_aflaw_pad_17 skip_tracks_hd4_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.51212763786288 Validation AUC 0.49185545967360733 skip_tracks_hd3_fnc2_spc33100_aflaw_pad_16 skip_tracks_hd3_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.48480130061423554 Validation AUC 0.4969170021807148 skip_tracks_hd1_fnc2_spc33400_aflaw_pad_17 skip_tracks_hd1_fnc2_spc33400_aflaw_pad_17 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.49226225401293244 Validation AUC 0.5245034868349056
skip_tracks_hd2_fnc2_spc33100_aflaw_pad_16 skip_tracks_hd2_fnc2_spc33100_aflaw_pad_16 0.5784973471320926 5 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4981338820768668 Validation AUC 0.4570521833729362 refined_srvo_flaw_cnt_hd2_fnc2_spc30300_a_flawscan_18 refined_srvo_flaw_cnt_hd2_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5542343236394661 Validation AUC 0.48467783195939573 refined_srvo_flaw_cnt_hd1_fnc2_spc30300_a_flawscan_18 refined_srvo_flaw_cnt_hd1_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5540009102719967 Validation AUC 0.5056837878350376 skip_tracks_hd4_fnc2_spc30300_a_flawscan_18 skip_tracks_hd4_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.48253044075202856 Validation AUC 0.4926008487346876 skip_tracks_hd5_fnc2_spc30300_a_flawscan_18 skip_tracks_hd5_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.49972493905691756 Validation AUC 0.4935703493970958 skip_tracks_hd3_fnc2_spc30300_a_flawscan_18 skip_tracks_hd3_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4974429827019067 Validation AUC 0.48179883030876414 refined_srvo_flaw_cnt_hd0_fnc2_spc30300_a_flawscan_18 refined_srvo_flaw_cnt_hd0_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5370061296148085 Validation AUC 0.49701131134051446 refined_srvo_flaw_cnt_hd3_fnc2_spc30300_a_flawscan_18 refined_srvo_flaw_cnt_hd3_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5433461480507229 Validation AUC 0.4817499046563349 refined_srvo_flaw_cnt_hd4_fnc2_spc30300_a_flawscan_18 refined_srvo_flaw_cnt_hd4_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5513826836174158 Validation AUC 0.4884353745307601 skip_tracks_hd0_fnc2_spc30300_a_flawscan_18 skip_tracks_hd0_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5402660511025154 Validation AUC 0.5027163518671743 skip_tracks_hd1_fnc2_spc30300_a_flawscan_18 skip_tracks_hd1_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4962879810279494 Validation AUC 0.49675034340437035 skip_tracks_hd2_fnc2_spc30300_a_flawscan_18 skip_tracks_hd2_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5316055965484678 Validation AUC 0.4893631612281474 refined_srvo_flaw_cnt_hd5_fnc2_spc30300_a_flawscan_18 refined_srvo_flaw_cnt_hd5_fnc2_spc30300_a_flawscan_18 0.6615150844060498 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5395356386636191 Validation AUC 0.4990473325364374 refined_srvo_flaw_cnt_hd5_fnc2_spc30200_a_flawscan_16 refined_srvo_flaw_cnt_hd5_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5363124102577496 Validation AUC 0.5027976666427113 refined_srvo_flaw_cnt_hd1_fnc2_spc30200_a_flawscan_16 refined_srvo_flaw_cnt_hd1_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.553110356446942 Validation AUC 0.5064413610590462 refined_srvo_flaw_cnt_hd0_fnc2_spc30200_a_flawscan_16 refined_srvo_flaw_cnt_hd0_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.546557739178599 Validation AUC 0.4947907449424668 refined_srvo_flaw_cnt_hd4_fnc2_spc30200_a_flawscan_16 refined_srvo_flaw_cnt_hd4_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5468575758566998 Validation AUC 0.48978273198301453 refined_srvo_flaw_cnt_hd2_fnc2_spc30200_a_flawscan_16 refined_srvo_flaw_cnt_hd2_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.55327797030822 Validation AUC 0.48673930482479344 skip_tracks_hd5_fnc2_spc30200_a_flawscan_16 skip_tracks_hd5_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5044514736659599 Validation AUC 0.49137184785996013 skip_tracks_hd4_fnc2_spc30200_a_flawscan_16 skip_tracks_hd4_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.48329588492684455 Validation AUC 0.49467598319367273 skip_tracks_hd1_fnc2_spc30200_a_flawscan_16 skip_tracks_hd1_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.49753966382822895 Validation AUC 0.4842638665155646 skip_tracks_hd3_fnc2_spc30200_a_flawscan_16 skip_tracks_hd3_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5185326002940018 Validation AUC 0.4876342437249661 skip_tracks_hd2_fnc2_spc30200_a_flawscan_16 skip_tracks_hd2_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5356755734766029 Validation AUC 0.49408319421161156 skip_tracks_hd0_fnc2_spc30200_a_flawscan_16 skip_tracks_hd0_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5350667957950903 Validation AUC 0.495847596077485 refined_srvo_flaw_cnt_hd3_fnc2_spc30200_a_flawscan_16 refined_srvo_flaw_cnt_hd3_fnc2_spc30200_a_flawscan_16 0.661540208023553 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5436102919732346 Validation AUC 0.4856569377407465 refined_srvo_flaw_cnt_hd0_fnc2_spc30100_a_flawscan_9 refined_srvo_flaw_cnt_hd0_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5465455470003368 Validation AUC 0.4960994715815525 refined_srvo_flaw_cnt_hd1_fnc2_spc30100_a_flawscan_9 refined_srvo_flaw_cnt_hd1_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5529320252788152 Validation AUC 0.5064229002121633 refined_srvo_flaw_cnt_hd3_fnc2_spc30100_a_flawscan_9 refined_srvo_flaw_cnt_hd3_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5441866628090293 Validation AUC 0.48565325047250657 refined_srvo_flaw_cnt_hd2_fnc2_spc30100_a_flawscan_9 refined_srvo_flaw_cnt_hd2_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5525151595518961 Validation AUC 0.48997515893045596 skip_tracks_hd0_fnc2_spc30100_a_flawscan_9 skip_tracks_hd0_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5356611473191951 Validation AUC 0.4972636305252747 skip_tracks_hd1_fnc2_spc30100_a_flawscan_9 skip_tracks_hd1_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5374632822577745 Validation AUC 0.5022745906209024 skip_tracks_hd5_fnc2_spc30100_a_flawscan_9 skip_tracks_hd5_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5039278054061522 Validation AUC 0.4918386614954762 skip_tracks_hd4_fnc2_spc30100_a_flawscan_9 skip_tracks_hd4_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4834171982714665 Validation AUC 0.49476401224005384 skip_tracks_hd2_fnc2_spc30100_a_flawscan_9 skip_tracks_hd2_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5346148461253206 Validation AUC 0.4971231794036699 skip_tracks_hd3_fnc2_spc30100_a_flawscan_9 skip_tracks_hd3_fnc2_spc30100_a_flawscan_9 0.6616011560586069 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5170676700574619 Validation AUC 0.4925059866001308 refined_srvo_flaw_cnt_hd4_fnc2_spc32700_aflaw_pad_15 refined_srvo_flaw_cnt_hd4_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5186045435420468 Validation AUC 0.4802860934274796 skip_tracks_hd4_fnc2_spc32700_aflaw_pad_15 skip_tracks_hd4_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4867535049179953 Validation AUC 0.4989530726893895 refined_srvo_flaw_cnt_hd1_fnc2_spc32700_aflaw_pad_15 refined_srvo_flaw_cnt_hd1_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5628754624959739 Validation AUC 0.501066901358476 skip_tracks_hd1_fnc2_spc32700_aflaw_pad_15 skip_tracks_hd1_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5220381148260713 Validation AUC 0.5073166824130758 skip_tracks_hd0_fnc2_spc32700_aflaw_pad_15 skip_tracks_hd0_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5345394193719525 Validation AUC 0.4950294270518262 skip_tracks_hd5_fnc2_spc32700_aflaw_pad_15 skip_tracks_hd5_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5229274228153338 Validation AUC 0.49944973310573143 skip_tracks_hd3_fnc2_spc32700_aflaw_pad_15 skip_tracks_hd3_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5045546994008208 Validation AUC 0.494771260856613 skip_tracks_hd2_fnc2_spc32700_aflaw_pad_15 skip_tracks_hd2_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5218328195132594 Validation AUC 0.49009198462650794 refined_srvo_flaw_cnt_hd5_fnc2_spc32700_aflaw_pad_15 refined_srvo_flaw_cnt_hd5_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5883162375157935 Validation AUC 0.5300719421705492
refined_srvo_flaw_cnt_hd0_fnc2_spc32700_aflaw_pad_15 refined_srvo_flaw_cnt_hd0_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5550451303549222 Validation AUC 0.4849713646603177 refined_srvo_flaw_cnt_hd2_fnc2_spc32700_aflaw_pad_15 refined_srvo_flaw_cnt_hd2_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.521037939603416 Validation AUC 0.48104155207033056 refined_srvo_flaw_cnt_hd3_fnc2_spc32700_aflaw_pad_15 refined_srvo_flaw_cnt_hd3_fnc2_spc32700_aflaw_pad_15 0.7715058165827041 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5410013199932703 Validation AUC 0.5069961867785949 refined_srvo_flaw_cnt_hd5_fnc2_spc32400_aflaw_pad_14 refined_srvo_flaw_cnt_hd5_fnc2_spc32400_aflaw_pad_14 0.7718677827756201 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.59242266932476 Validation AUC 0.530340706976814
refined_srvo_flaw_cnt_hd4_fnc2_spc32400_aflaw_pad_14 refined_srvo_flaw_cnt_hd4_fnc2_spc32400_aflaw_pad_14 0.7718677827756201 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5189043973689861 Validation AUC 0.481679591080396 skip_tracks_hd4_fnc2_spc32400_aflaw_pad_14 skip_tracks_hd4_fnc2_spc32400_aflaw_pad_14 0.7718677827756201 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.48640519608222427 Validation AUC 0.4980513847994663 skip_tracks_hd5_fnc2_spc32400_aflaw_pad_14 skip_tracks_hd5_fnc2_spc32400_aflaw_pad_14 0.7718677827756201 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5247962310782274 Validation AUC 0.5054283428989333 refined_srvo_flaw_cnt_hd4_fnc2_spc32100_aflaw_pad_13 refined_srvo_flaw_cnt_hd4_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5184179358648605 Validation AUC 0.481072514463901 skip_tracks_hd3_fnc2_spc32400_aflaw_pad_14 skip_tracks_hd3_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5070129531164951 Validation AUC 0.501627802807328 refined_srvo_flaw_cnt_hd3_fnc2_spc32100_aflaw_pad_13 refined_srvo_flaw_cnt_hd3_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5438273670942301 Validation AUC 0.5104270573467682 refined_srvo_flaw_cnt_hd2_fnc2_spc32100_aflaw_pad_13 refined_srvo_flaw_cnt_hd2_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5225457754882782 Validation AUC 0.48147835565046687 refined_srvo_flaw_cnt_hd2_fnc2_spc32400_aflaw_pad_14 refined_srvo_flaw_cnt_hd2_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5218213822668897 Validation AUC 0.4799869953669242 skip_tracks_hd2_fnc2_spc32400_aflaw_pad_14 skip_tracks_hd2_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5226573081727045 Validation AUC 0.4894357248614573 skip_tracks_hd0_fnc2_spc32100_aflaw_pad_13 skip_tracks_hd0_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5400476418201318 Validation AUC 0.4990241511484012 skip_tracks_hd1_fnc2_spc32400_aflaw_pad_14 skip_tracks_hd1_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5236503016914913 Validation AUC 0.5056364768212698 skip_tracks_hd0_fnc2_spc32400_aflaw_pad_14 skip_tracks_hd0_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5357598476712294 Validation AUC 0.4934504292533514 skip_tracks_hd2_fnc2_spc32100_aflaw_pad_13 skip_tracks_hd2_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5255820408702129 Validation AUC 0.49400738734761895 refined_srvo_flaw_cnt_hd5_fnc2_spc32100_aflaw_pad_13 refined_srvo_flaw_cnt_hd5_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5924547497993171 Validation AUC 0.5296524732645816
skip_tracks_hd3_fnc2_spc32100_aflaw_pad_13 skip_tracks_hd3_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5078061005243554 Validation AUC 0.499719668665874 refined_srvo_flaw_cnt_hd3_fnc2_spc32400_aflaw_pad_14 refined_srvo_flaw_cnt_hd3_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5439690769850448 Validation AUC 0.5108469740575461 skip_tracks_hd1_fnc2_spc32100_aflaw_pad_13 skip_tracks_hd1_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5227722627455214 Validation AUC 0.5015508470141672 refined_srvo_flaw_cnt_hd1_fnc2_spc32400_aflaw_pad_14 refined_srvo_flaw_cnt_hd1_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5640184805068393 Validation AUC 0.5006068584273005 refined_srvo_flaw_cnt_hd0_fnc2_spc32100_aflaw_pad_13 refined_srvo_flaw_cnt_hd0_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5532214423890447 Validation AUC 0.484502137567043 refined_srvo_flaw_cnt_hd1_fnc2_spc32100_aflaw_pad_13 refined_srvo_flaw_cnt_hd1_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5630963272542436 Validation AUC 0.5009237062764174 skip_tracks_hd5_fnc2_spc32100_aflaw_pad_13 skip_tracks_hd5_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5271644636349135 Validation AUC 0.5061889968544732 skip_tracks_hd4_fnc2_spc32100_aflaw_pad_13 skip_tracks_hd4_fnc2_spc32100_aflaw_pad_13 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4845135965717806 Validation AUC 0.49846290818973793 refined_srvo_flaw_cnt_hd0_fnc2_spc32400_aflaw_pad_14 refined_srvo_flaw_cnt_hd0_fnc2_spc32400_aflaw_pad_14 0.7718682480277961 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5541185186473573 Validation AUC 0.4837049346002494 skip_tracks_hd5_fnc2_spc1_aflaw_pad_12 skip_tracks_hd5_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5271111210769721 Validation AUC 0.5061534440026466 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_12 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5630410984405133 Validation AUC 0.5008939154532082 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_12 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.55316807833473 Validation AUC 0.4844762252164646 skip_tracks_hd4_fnc2_spc1_aflaw_pad_12 skip_tracks_hd4_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.4845640836135541 Validation AUC 0.49849461553339736 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_12 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.54379276882934 Validation AUC 0.5103991884304828 refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_12 refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.522518472919219 Validation AUC 0.4814595234317738 skip_tracks_hd0_fnc2_spc1_aflaw_pad_12 skip_tracks_hd0_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5399977373261968 Validation AUC 0.4989976498480447 skip_tracks_hd1_fnc2_spc1_aflaw_pad_12 skip_tracks_hd1_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5227213531825363 Validation AUC 0.5015142419631867 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_12 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.592391946577516 Validation AUC 0.5296154808465642
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_12 refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.518443593578247 Validation AUC 0.4810096619503933 skip_tracks_hd2_fnc2_spc1_aflaw_pad_12 skip_tracks_hd2_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5255481329245246 Validation AUC 0.4939805001005707 skip_tracks_hd3_fnc2_spc1_aflaw_pad_12 skip_tracks_hd3_fnc2_spc1_aflaw_pad_12 0.7718729005495558 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5077701204836287 Validation AUC 0.4996887899077572 skip_tracks_hd4_fnc2_spc30600_aflaw_pad_10 skip_tracks_hd4_fnc2_spc30600_aflaw_pad_10 0.772346992516884 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.48056323491719394 Validation AUC 0.49448862981084607 skip_tracks_hd2_fnc2_spc30600_aflaw_pad_10 skip_tracks_hd2_fnc2_spc30600_aflaw_pad_10 0.772346992516884 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5245763146417053 Validation AUC 0.5007664249821724 skip_tracks_hd0_fnc2_spc30600_aflaw_pad_10 skip_tracks_hd0_fnc2_spc30600_aflaw_pad_10 0.772346992516884 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5457066524583323 Validation AUC 0.5124609210018057 refined_srvo_flaw_cnt_hd0_fnc2_spc30600_aflaw_pad_10 refined_srvo_flaw_cnt_hd0_fnc2_spc30600_aflaw_pad_10 0.772346992516884 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5579257421489476 Validation AUC 0.48819419733217945 refined_srvo_flaw_cnt_hd2_fnc2_spc30600_aflaw_pad_10 refined_srvo_flaw_cnt_hd2_fnc2_spc30600_aflaw_pad_10 0.772346992516884 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5173719426676969 Validation AUC 0.4780178254504834 refined_srvo_flaw_cnt_hd4_fnc2_spc30600_aflaw_pad_10 refined_srvo_flaw_cnt_hd4_fnc2_spc30600_aflaw_pad_10 0.772346992516884 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5166942286285647 Validation AUC 0.48124538884221996 refined_srvo_flaw_cnt_hd5_fnc2_spc30600_aflaw_pad_10 refined_srvo_flaw_cnt_hd5_fnc2_spc30600_aflaw_pad_10 0.77234745776906 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5986827627354063 Validation AUC 0.5465976553385162
skip_tracks_hd3_fnc2_spc30600_aflaw_pad_10 skip_tracks_hd3_fnc2_spc30600_aflaw_pad_10 0.77234745776906 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5099073150829675 Validation AUC 0.4861371190825619 refined_srvo_flaw_cnt_hd1_fnc2_spc30600_aflaw_pad_10 refined_srvo_flaw_cnt_hd1_fnc2_spc30600_aflaw_pad_10 0.77234745776906 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5737018187384407 Validation AUC 0.49739667431825063 skip_tracks_hd5_fnc2_spc30600_aflaw_pad_10 skip_tracks_hd5_fnc2_spc30600_aflaw_pad_10 0.77234745776906 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5290478334861127 Validation AUC 0.5108256490639965 refined_srvo_flaw_cnt_hd3_fnc2_spc30600_aflaw_pad_10 refined_srvo_flaw_cnt_hd3_fnc2_spc30600_aflaw_pad_10 0.77234745776906 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5450211780821835 Validation AUC 0.5125613897386859 skip_tracks_hd1_fnc2_spc30600_aflaw_pad_10 skip_tracks_hd1_fnc2_spc30600_aflaw_pad_10 0.77234745776906 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5208948426296184 Validation AUC 0.5002510813716227 refined_srvo_flaw_cnt_hd0_fnc2_spc1_zap_14 refined_srvo_flaw_cnt_hd0_fnc2_spc1_zap_14 0.7825513684927504 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.49705603258610953 Validation AUC 0.472903722737411 refined_srvo_flaw_cnt_hd2_fnc2_spc1_zap_14 refined_srvo_flaw_cnt_hd2_fnc2_spc1_zap_14 0.7825513684927504 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5163853429360223 Validation AUC 0.4980415805607566 skip_tracks_hd2_fnc2_spc1_zap_14 skip_tracks_hd2_fnc2_spc1_zap_14 0.7825513684927504 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5896986414074318 Validation AUC 0.5119407540731472 skip_tracks_hd0_fnc2_spc1_zap_14 skip_tracks_hd0_fnc2_spc1_zap_14 0.7825513684927504 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5255842560394961 Validation AUC 0.4988479576068778 skip_tracks_hd4_fnc2_spc1_zap_14 skip_tracks_hd4_fnc2_spc1_zap_14 0.7825513684927504 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5966895778971303 Validation AUC 0.5068298047665185 refined_srvo_flaw_cnt_hd4_fnc2_spc1_zap_14 refined_srvo_flaw_cnt_hd4_fnc2_spc1_zap_14 0.7825513684927504 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5208690298674638 Validation AUC 0.5182232087443601 refined_srvo_flaw_cnt_hd3_fnc2_spc1_zap_14 refined_srvo_flaw_cnt_hd3_fnc2_spc1_zap_14 0.7825518337449264 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.49428467396966524 Validation AUC 0.5013946060161408 skip_tracks_hd3_fnc2_spc1_zap_14 skip_tracks_hd3_fnc2_spc1_zap_14 0.7825518337449264 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5557164285446432 Validation AUC 0.5019458860357056 refined_srvo_flaw_cnt_hd5_fnc2_spc1_zap_14 refined_srvo_flaw_cnt_hd5_fnc2_spc1_zap_14 0.7825518337449264 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5057616653387338 Validation AUC 0.4976693587674248 skip_tracks_hd5_fnc2_spc1_zap_14 skip_tracks_hd5_fnc2_spc1_zap_14 0.7825518337449264 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5910817758036451 Validation AUC 0.4905278180484226 skip_tracks_hd1_fnc2_spc1_zap_14 skip_tracks_hd1_fnc2_spc1_zap_14 0.7825518337449264 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5646900424980643 Validation AUC 0.4994559589141599 refined_srvo_flaw_cnt_hd1_fnc2_spc1_zap_14 refined_srvo_flaw_cnt_hd1_fnc2_spc1_zap_14 0.7825518337449264 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5138024005037016 Validation AUC 0.510562647101981 skip_tracks_hd3_fnc2_spc1_aflaw_pad_11 skip_tracks_hd3_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6052852932268068 Validation AUC 0.49749381766527234 skip_tracks_hd2_fnc2_spc1_aflaw_pad_11 skip_tracks_hd2_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6273704310891534 Validation AUC 0.4990752095793506 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_11 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6203698650462284 Validation AUC 0.5048855958502427 skip_tracks_hd5_fnc2_spc1_aflaw_pad_11 skip_tracks_hd5_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6187482297598452 Validation AUC 0.504681656877444 skip_tracks_hd4_fnc2_spc1_aflaw_pad_11 skip_tracks_hd4_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6284332096643446 Validation AUC 0.507716318635205 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_11 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6125680531005274 Validation AUC 0.5335184440713425
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_11 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.614363285721432 Validation AUC 0.5228681214490254
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_11 refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6155020508342857 Validation AUC 0.5182645404655627 skip_tracks_hd0_fnc2_spc1_aflaw_pad_11 skip_tracks_hd0_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6005481072360644 Validation AUC 0.5108610854646937 skip_tracks_hd1_fnc2_spc1_aflaw_pad_11 skip_tracks_hd1_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5992481126965286 Validation AUC 0.49513793196239997 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_11 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6538785745224837 Validation AUC 0.5249864552955132
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_11 refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_11 0.9435690983226729 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6342941998963666 Validation AUC 0.5052569373537581 refined_srvo_flaw_cnt_hd2_fnc2_spc30310_aflaw_pad_9 refined_srvo_flaw_cnt_hd2_fnc2_spc30310_aflaw_pad_9 0.9438622071935431 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5831316894735846 Validation AUC 0.5192875634099136 refined_srvo_flaw_cnt_hd0_fnc2_spc30310_aflaw_pad_9 refined_srvo_flaw_cnt_hd0_fnc2_spc30310_aflaw_pad_9 0.9438622071935431 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5797187254977406 Validation AUC 0.5230586177857821
skip_tracks_hd0_fnc2_spc30310_aflaw_pad_9 skip_tracks_hd0_fnc2_spc30310_aflaw_pad_9 0.9438622071935431 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5221725509241829 Validation AUC 0.5144449190140064 skip_tracks_hd4_fnc2_spc30310_aflaw_pad_9 skip_tracks_hd4_fnc2_spc30310_aflaw_pad_9 0.9438622071935431 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5950226578843325 Validation AUC 0.5115649545245519 refined_srvo_flaw_cnt_hd4_fnc2_spc30310_aflaw_pad_9 refined_srvo_flaw_cnt_hd4_fnc2_spc30310_aflaw_pad_9 0.9438622071935431 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6238726025070629 Validation AUC 0.5046064085280995 skip_tracks_hd2_fnc2_spc30310_aflaw_pad_9 skip_tracks_hd2_fnc2_spc30310_aflaw_pad_9 0.9438622071935431 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5718198573937454 Validation AUC 0.5014624313970957 skip_tracks_hd1_fnc2_spc30310_aflaw_pad_9 skip_tracks_hd1_fnc2_spc30310_aflaw_pad_9 0.943862672445719 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5322299356615897 Validation AUC 0.4964456774804838 skip_tracks_hd5_fnc2_spc30310_aflaw_pad_9 skip_tracks_hd5_fnc2_spc30310_aflaw_pad_9 0.943862672445719 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.551225822487375 Validation AUC 0.5073837641110566 refined_srvo_flaw_cnt_hd1_fnc2_spc30310_aflaw_pad_9 refined_srvo_flaw_cnt_hd1_fnc2_spc30310_aflaw_pad_9 0.943862672445719 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5862163807748318 Validation AUC 0.5047695535468765 refined_srvo_flaw_cnt_hd3_fnc2_spc30310_aflaw_pad_9 refined_srvo_flaw_cnt_hd3_fnc2_spc30310_aflaw_pad_9 0.943862672445719 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5771458092153473 Validation AUC 0.5354210731470229
skip_tracks_hd3_fnc2_spc30310_aflaw_pad_9 skip_tracks_hd3_fnc2_spc30310_aflaw_pad_9 0.943862672445719 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5477006802828172 Validation AUC 0.49172326335809574 refined_srvo_flaw_cnt_hd5_fnc2_spc30310_aflaw_pad_9 refined_srvo_flaw_cnt_hd5_fnc2_spc30310_aflaw_pad_9 0.943862672445719 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6359163292698116 Validation AUC 0.5239680577290379
skip_tracks_hd2_fnc2_spc1_aflaw_pad_7 skip_tracks_hd2_fnc2_spc1_aflaw_pad_7 0.9438673249674788 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5718512964639679 Validation AUC 0.5015041689025115 refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_7 refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_7 0.9438673249674788 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5831253021324182 Validation AUC 0.5192922721822452 skip_tracks_hd0_fnc2_spc1_aflaw_pad_7 skip_tracks_hd0_fnc2_spc1_aflaw_pad_7 0.9438673249674788 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5222111730236767 Validation AUC 0.5142946742823168 refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_7 refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_7 0.9438673249674788 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6238583075197048 Validation AUC 0.5044292359591012 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_7 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_7 0.9438673249674788 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5795381509200122 Validation AUC 0.5230666711337794
skip_tracks_hd4_fnc2_spc1_aflaw_pad_7 skip_tracks_hd4_fnc2_spc1_aflaw_pad_7 0.9438673249674788 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5950381486783798 Validation AUC 0.5116003904820868 skip_tracks_hd1_fnc2_spc1_aflaw_pad_7 skip_tracks_hd1_fnc2_spc1_aflaw_pad_7 0.9438677902196548 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5322694089385156 Validation AUC 0.49622010021533536 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_7 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_7 0.9438677902196548 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6359212915947279 Validation AUC 0.5239748650616219
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_7 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_7 0.9438677902196548 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.586225544148521 Validation AUC 0.5047763011778581 skip_tracks_hd5_fnc2_spc1_aflaw_pad_7 skip_tracks_hd5_fnc2_spc1_aflaw_pad_7 0.9438677902196548 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5512562726325391 Validation AUC 0.5074326048638698 skip_tracks_hd3_fnc2_spc1_aflaw_pad_7 skip_tracks_hd3_fnc2_spc1_aflaw_pad_7 0.9438677902196548 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5477349856340565 Validation AUC 0.49152282184606133 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_7 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_7 0.9438677902196548 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5771536920385529 Validation AUC 0.5352516864263073
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_4 refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_4 0.9439338560286447 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5890997062607198 Validation AUC 0.5199997959129459 skip_tracks_hd0_fnc2_spc1_aflaw_pad_4 skip_tracks_hd0_fnc2_spc1_aflaw_pad_4 0.9439338560286447 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5214688428419335 Validation AUC 0.5159631332087508 skip_tracks_hd2_fnc2_spc1_aflaw_pad_4 skip_tracks_hd2_fnc2_spc1_aflaw_pad_4 0.9439338560286447 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5729187359589027 Validation AUC 0.4997871766911988 refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_4 refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_4 0.9439338560286447 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6249966237782327 Validation AUC 0.5081700792283197 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_4 refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_4 0.9439338560286447 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5795852282443013 Validation AUC 0.5220470974196935
skip_tracks_hd4_fnc2_spc1_aflaw_pad_4 skip_tracks_hd4_fnc2_spc1_aflaw_pad_4 0.9439338560286447 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5888677304450097 Validation AUC 0.5107358858906791 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_4 refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_4 0.9439343212808207 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.6307790320180574 Validation AUC 0.5130163548614761 skip_tracks_hd5_fnc2_spc1_aflaw_pad_4 skip_tracks_hd5_fnc2_spc1_aflaw_pad_4 0.9439343212808207 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5464790400524444 Validation AUC 0.5064148240337392 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_4 refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_4 0.9439343212808207 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5869427323968028 Validation AUC 0.5065514039012744 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_4 refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_4 0.9439343212808207 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5806837498407144 Validation AUC 0.5278726553817313
skip_tracks_hd3_fnc2_spc1_aflaw_pad_4 skip_tracks_hd3_fnc2_spc1_aflaw_pad_4 0.9439343212808207 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5482853586297707 Validation AUC 0.49079608575545586 skip_tracks_hd1_fnc2_spc1_aflaw_pad_4 skip_tracks_hd1_fnc2_spc1_aflaw_pad_4 0.9439343212808207 5 bins processed 15 bins processed glm Model Build progress: |███████████████████████████████████████████████| 100% Training AUC 0.5314723137047478 Validation AUC 0.49538462975234365